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Abstract. We present a new methodology for computing approximate 
Nash equilibria for two-person non-cooperative games based upon certain 
extensions and specializations of an existing optimization approach pre- 
viously used for the derivation of fixed approximations for this problem. 
In particular, the general two-person problem is reduced to an indefi- 
nite quadratic programming problem of special structure involving the 
n X n adjacency matrix of an induced simple graph specified by the in- 
put data of the game, where n is the number of players' strategies. Using 
this methodology and exploiting certain properties of the positive part 
of the spectrum of the induced graph, we show that for any e > there 
is an algorithm to compute an e-approximate Nash equilibrium in time 
where, ^{m) — X^I^i'^'/'^ ^^'^ Xi, X2, ■ ■ ■ , Xm are the positive 
eigenvalues of the adjacency matrix of the graph. For classes of games 
for which (,{m) is a constant, there is a PTAS. Based on the best upper 
bound derived for ^(m) so far, the worst case complexity of the method 
is bounded by the subexponential n^^^^ . 



1 Introduction and notation 

It is well known that the problem of computing an exact Nash equilibrium 
is PPAD-complete even for 2-player games. Furthermore, the seemingly easier 
problem of computing an e-approximate equilibrium for e inversely proportional 
to a polynomial in n is also PPAD-complete. These results are established in 
[3] and [4]. For the definition and insight into the complexity class PPAD and 
its connection with the more general Nash equilibrium problem, the interested 
reader is referred to [8] and [5]. 

In view of such complexity results, attention has been focused in the past few 
years on the problem of finding e-approximate equilibria in polynomial time for 
some constant e. However, despite considerable efforts in this direction, it has 
not been possible so far to achieve in polynomial time guaranteed constant ap- 
proximations better than e = 0.3393 for general bimatrix games and e = 1/4 for 
{0, 1} win-lose games. The latter approximation results are established in [3] and 
[TO] and have been achieved by using an optimization-based approach through 
the application of a descent algorithm that computes a stationary point of an 
appropriately defined non-convex regret function. This optimization approach 



has also been experimentally tested and has been proven effective in practice, as 
demonstrated in [TT] , 

In this paper we are extending the latter approach by further exploring the 
special structure of the optimization problem that represents a game. At first, 
the general problem of finding an approximate equilibrium of a bimatrix game 
is reduced to a problem of finding an approximate symmetric equilibrium of a 
symmetric bimatrix game. This leads to an indefinite quadratic programming 
problem over the space of n-dimensional probability vectors involving a single 
square nonnegative matrix A and a regret function fA{x) to be minimized. The 
problem is further reduced to a {0, 1} win-lose game, where, the matrix A can 
be considered as the adjacency matrix of a simple directed graph, called here the 
induced graph and which is uniquely specified by the game problem. Next, we 
consider a spectral representation of the optimization problem in terms of the 
eigenvalues and eigenvectors of the adjacency matrix A + A"^ of the undirected 
version of the induced graph. The results presented here are based on the spectral 
properties of the graph in conjunction with the properties of stationary points 
of the regret function. 

We adopt the following notation throughout the paper: 

— For any positive integer fc, [k] denotes the set of integers from 1 to k. Also, 
e denotes the column vector of appropriate dimension having all its entries 
equal to 1. 

— Ak ~ {u : u ^ ^^,u > 0, e'^u — 1} is the fc-dimensional standard simplex 
(superscript r denotes transpose). Alternatively, we refer to it as the set of 
fc-dimensional probability vectors. 

— supp{u) = {« G [k] : Ui ^ 0} denotes the subset of integers (indices) in [fc] 
constituting the support of vector u G 3?*^. 

— suppmax{u) = {i € [k] : Ui > Uj Vj' € [fc]} is the subset of indices in [fc] for 
which the corresponding entries of vector u £ di'' are equal to the maximum 
entry value of u. 

— max(u) = {ui : Ui > Uj, for allj} is the value of the maximum entry of vector 
u. 

— maxs'(it) = {mj, i G S : Ui > Uj , for all j e S} is the value of the maximum 
entry of a vector u within an index subset 5* C [fc] . 

2 Related results 

In regard to the complexity result derived from the methodology we present here, 
it is necessary to make a comparison with an existing subexponential algorithm 
for computing approximate Nash equilibria presented in [7]. This algorithm is 
based on an exhaustive search over all possible supports of size 0(lnn/e^) that 
achieves an e-approximate equilibrium in time n*^^'""/"^ -'. The proof of exis- 
tence of the approximation is based on the probabilistic method. Considering as 
performance indicators the two parameters representing the approximation to 
a Nash equilibrium and the size of the game (i.e. the approximation parameter 
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e and the number of strategies n respectively), there is no uniform comparison 
between the complexity bound of the latter method and the one presented here: 
For a given e, the result in [7j outperforms the result we present here for arbi- 
trarily large n, larger than a threshold no(£). On the other hand, for a given n 
our result outperforms the result in [7j for arbitrarily small e, smaller than a 
threshold ef){n) = n^^(n). By taking into account also the constants involved 
in the exponents of the complexity bounds of the two methods (for the former 
method the constant multiplying Inn/e^ is 12 and for the method we present 
here the corresponding constant is less than 1), the threshold curve is given 
approximately by the equation e ~ 121nn/Y^. The comparison of the two re- 
sults are shown below in tabular form (rri ~ number of positive eigenvalues < n): 
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It turns out that even for modest values of e, the values of the threshold no 
(above which the method of [7] outperforms our method) are simply too large, 
large enough to render any subexponential scheme totally unrealistic anyway. 
Indicatively, for e — 1/3 we have rio(l/3) « 2 x 10^ and for e = 0.15 we have 
no(0.15) « 1.2 X 10^ and this threshold increases very fast when e becomes even 
smaller. So, the method presented here is more efficient than the one presented 
in [7] for all practical purposes. 

3 Reduction to symmetric games 

Let n be a positive integer and let A be a real square n x n matrix. We assume, 
without loss of generality, that A is normalized so that its maximum entry is 1 
and its minimum entry is 0. For any x G An we define the following function 
mapping Z\„ into [0, 1]: 

fA{x) = ma,x{Ax) — x^Ax (1) 

Minimizing fA{x) over x € Z\„ is equivalent to finding symmetric Nash equi- 
libria of the symmetric game (A, A^). It is also equivalent to finding Nash equi- 
libria of the imitation game {A, I), where / is the n x n identity matrix. 

Given a non-cooperative two-person game with payoff matrices {R^C), the 
problem of finding an exact Nash equilibrium can be reduced to the problem of 
finding an exact symmetric equilibrium of a symmentric game, or, equivalently 
to finding a solution of an equation of the form Ja^x) — for an appropriate 
choice of the matrix A. The theorem below extends this result to approximate 
Nash equilibria as well. 

Theorem 1. Given a procedure that for any (normalized) square nxn matrix A 
and any e > returns an x € An such that fA{x) < e, then, an 0{e) -approximate 
equilibrium for any bimatrix game (i?, C) can be obtained in polynomial time. 
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Proof. Given a bimatrix game with payoff matrices (i?, C) (entries of both ma- 
trices are normahzed in [0, 1]), let us define the constants ci = min„ max„(w'^iiu) 
and C2 = min^ max„(t;'^Cu), where the min and max are taken over appropri- 
ately dimensioned probability vectors v and u. Let ^i, I2 be the number of rows 
and columns of the game respectively. 

To avoid trivial cases we assume that no row of R is dominated by its other 
rows (i.e. for every row of R there is a ?i-dimensional probability vector whose 
inner product with this row is greater than its inner product with any other 
row of R) and, similarly, no column of C is dominated by the its other columns. 
Indeed, if some row of R (or some column of C) is dominated, then we can 
remove it from both matrices and reduce the dimensionality of the problem. In 
such cases, any Nash equilibrium of the reduced problem is also an equilibrium of 
the original game (notice that this procedure may eliminate some Nash equilibria 
of the original game. However, it will retain at least one). Also, we assume that 
no column of R has all its entries equal to and no row of C has all its entries 
equal to 0. Indeed, if, for example a column j of R is zero, then we can easily 
construct a Nash equilibrium by having the column player play j and the row 
player play a probability vector that makes j dominant among the columns of 
C. A similar argument can be applied if a row of C is zero. Note that checking 
for dominance of a row or column can be done in polynomial time by solving 
linear feasibility problems. 

Using the above assumptions, it is easy to see that the constants ci and C2 
satisfy: ci > and C2 > 0. Let us define the square n x n matrix A (where, 
n = h + I2) as follows : 



Fix e > such that e < ^min{ci, C2). Let x be an n-dimensional probability 
vector such that /a (2;) < £• Let xc and xji be the nonnegative vectors consisting 
of the first I2 entries and the last h entries of x respectively, i.e. x'^ = {xQ,Xjf). 
Under the specified constraints, it can be verified that xc and xr 7^ 0. 
Normalize xc and x^ to make each one of them a probability vector (we use 
the same notation for simplicity). Let Mi = max(i?xc) and M2 = max.{C'^XR). 
Let fR{xR,xc) = Ml - x^^Rxc and fc{xR,xc) = M2 - x^^Cxc be the two 
regret functions for the row and column player respectively. Selecting a new n- 
dimensional vector xl = M1+M2 {^"^^C' -^i^fl)' '^^^ ^e verified that fA{xi) < 
fA{x) < €. Expressing fA{xi) in terms of /r and fc and using the inequalities 
Cl < Ml < 1 and C2 < M2 < 1, we obtain: 

X , / X (Ml +M2)2 ,1 1 , 
fnixR, xc) + fc{xR, xc)< ^ ' , , £ < 2 - + - e 

M1M2 Cl C2 

which proves the claim. 

□ 

Based on the above result we can focus our attention (without loss of gen- 
erality) on the problem of approximating a minimum of a function of the form 
/a (a;) for square matrices A having the following properties: 
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— All entries are nonnegative in the interval [0, 1] 

— Zero entries along the principal diagonal: An = 

— No column of A is identically zero 

— No row of A is dominated by the other rows 

4 Stationary points and properties 

Following the analysis, results and terminology of ^9] and [10], adapted here for 
the case of symmetric games (which makes things simpler, at least in terms of 
notation), we define stationary points of the function fA{x) and summarize their 
properties in a series of definitions and theorems below which we state without 
proof. 

Definition 1. The gradient Da{x\x) of the function fA{x) = ma.x{Ax) — 
Ax at X £ An along a direction x' € Z\„ is defined as follows: 

Da{x',x) = lim - <^)x + ex') - /a (a:)) 

Theorem 2. The limit in the above definition always exists for any x G Z\„ and 
x' G An- Furthermore, for given x it defines a convex function Da{x',x) of x' , 
involving the max(.) of an affine function of x' , given by the equation: 

Da{x\x) = max {Ax') - x'' Ax' -{x'Y Ax^ x'^Ax - 

supprnax{Ax) 

Definition 2. A probability vector x* G An is called a stationary point of the 

function fA{x) — max(Aa;) — x'^Ax, if Da{x,x*) > 0,Va; G 

Theorem 3. A stationary point always exists and can be approximated as closely 
as desired in polynomial time through an iterative descent algorithm applied to 
the function /^(a;). The algorithm can start from an arbitrary xq G Z\„ and in- 
volves solving a linear programming problem of the form min^^g/i^^ (_Dyi(x, Xk)) at 
each step k. Furthermore, every Nash equilibrium is a stationary point. 

Definition 3. For any probability vector x G An, a probability vector w G An is 
called an associated dual vector if it is a solution of the dual of the linear problem 
miiix' (^a„{F)a{x' , x)) , where all constraints are dualized except those specified by 
x' G An. 

Theorem 4. For any probability vector x G An, the support of an associated 
dual vector w G An satisfies supp{w) C suppmax{Ax) . 

Theorem 5. Letx* G An be a stationary point and define S{x*) = suppmax{Ax*) . 
Let w* G An be an associated dual probability vector (which satisfies supp{w*) C 
S{x*) according to the previous theorem). Then, the following relationships (called 
here stationarity conditions) hold: 

max(Aa;) - {x*)'' Ax - x'' Ax* + {x*)^ Ax* - fA{x*) > 0,Vx G Z\„ 

S{x*) 

{w*)''Ax - {x*)^Ax - x^Ax* + {x*)^Ax* - fA{x*) > 0,Va; G Z\„ 
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The first relationship in the above theorem yields: 

fA{x*) - fA{x) + (max(Ax) - max{Ax)) < {x - x*yA{x - x*),\/x G Z\„ (2) 

Also, setting x = w* in the second relationship of the above theorem we 
obtain: 

fAix*) < (w* - x*YA{w* - X*) (3) 
or, equivalently, since supp{w*) C S{x*): 

2fA{x*) + fA{w*) < ma.x{Aw*) - {x*yAw* (4) 

From the above equation we get: 

Theorem 6. Given a stationary point x* and associated dual w* , either fA{x*) 

or fA{w*) should be < ^. 

Another result which is a direct consequence of previous relationships involv- 
ing stationary points is summarized in the theorem below. 

Theorem 7. For any two stationary points x*,X2, the following relationship 
holds: 

IfAixl) - fA{x*2)\ < {xl - x^^YAixl - x^) (5) 

As we will see later, equation (5) above is important as it provides an upper 
bound on the quality of approximate Nash equilibria in terms of a symmetric 
quadratic form of the difference between stationary points. Notice that a similar 
relationship holds more generally for any pair of points Xi,X2 G Z\„ satisfying 
the condition that neither x\ defines a descent direction for fA{-) at X2 nor x^ 
defines a descent direction for at xi, or equivalently, both Da{xi,X2) and 

Da{x2-, xi) are > 0. If one of the two points, say xi, is a Nash equilibrium and 
at the same time it does not define a descent direction for at the other 

point X2, then, fA{x2) < {xi — X2Y A(xi — X2). So, if any point X2 is close to 
a Nash equilibrium in the squared metric defined by the symmetric quadratic 
form, then, it will either be an approximate equilibrium of the same quality, or 
there will be a descent direction from it. The above remarks are being used later 
in Section 7 to establish the approximation result. 

Definition 4. For a given convex set K C An, a probability vector x* € K is 
called a constrained stationary point of the function fA{x) = max(Aa;) — 
x'^Ax, ifDA{x,x*) > 0,Va; e K. 

A constrained stationary point can be obtained in a similar way by start- 
ing from any xq € K and solving a linear programming problem of the form 
mmx^K{F)A{x,Xk)) at each step k until convergence. In other words, we have 
additional constraints to deal with at each step of the descent algorithm. It is 
pointed out here that the rate of convergence of the descent algorithm to a 
(constrained) stationary point is not essentially affected by the additional con- 
straints. The additional constraints affect the descent direction while the rate of 
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convergence depends primarily on the stepsize given a descent direction. This can 
be verified by an overview of the convergence analysis presented in [9] and |10| . 
Therefore, a constrained stationary point can also be obtained in polynomial 
time. 

5 Spectral representation 

Consider the spectral representation of the matrix A + . Since this matrix 
is symmetric, all its eigenvalues are real and the eigenvectors are mutually or- 
thogonal. Let Ai, A2, . . . , Am be the m positive eigenvalues oi A + (m < n) 
and — |Am+i I, — |A„i+2|, • ■ • , — |A„| the negative ones. Let z^, i = 1, 2, . . . , n be the 
corresponding normalized eigenvectors satisfying ||zi|| = 1 for all i e [n] and 
zjzj = for all i,j such that i ^ j. By ||.|| we denote the usual Euchdean 
L2 norm. Assume that the eigenvalues are indexed in descending order, i.e. 
Ai > A2 > ... > A„. 

Considering the representation of ^ + A'^ in terms of its eigenvalues and 
eigenvectors 

ni n 

A^ A^ = Y^\z^zl - J2 (6) 

i—1 j—m-\-l 

the function fA{x) can be written as follows: 

^ n ^ m 

U{x)^max{Ax) + - ^ \X,\iz]xf~-Y,\,{zJxf (7) 

j—m+l i—1 

Let A^ = ^i^i^i be the symmetric nonnegative definite nxn matrix of 

rank m that defines the last term of the above equation involving the m positive 
eigenvalues. The complexity of finding a solution of the problem min-^g^,^ fA{x) 
is due exclusively to this term since this term is responsible for the non-convexity 
of the problem. In particular, the complexity is driven by the geometry of the 
orthogonal projection of the feasible region of probability vectors Z\„ onto the 
m-dimensional linear subspace spanned by the eigenvectors Zi,i = 1,2,. ..,to 
(that correspond to the positive eigenvalues) endowed with a distance metric 
d{., .) defined by (P{a,b) — K{zi{a — 6))^, i.e. the metric induced by the 

matrix A^ . Expressing the distance between stationary points in terms of this 
metric, we notice that equation (5) implies that for any two stationary points 
X , X'2 the following is true: 

< (8) 

We notice that the problem can be treated as an indefinite quadratic pro- 
gramming problem with linear constraints. A general result for such problems, 
obtained from |12j . states that there is an algorithm to find an e-approximate 

solution in Of ( "^"t^^ )" j steps, where K{n) denotes the time to solve a 
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convex quadratic problem of size n. An immediate consequence is that if the 
number m of positive eigenvalues of A + is a small number, then there is an 
FPTAS for finding a Nash equilibrium. However, in such cases (where the num- 
ber m of positive eigenvalues is fixed) there is more structure in a game problem 
that can be exploited: Notice that m is bounded by the rank of the matrix and 
as pointed out in [l3j if the rank is fixed then there is a strongly polynomial 
algorithm to compute a Nash equilibrium. 

The special structure of the game problem can generally be exploited to 
yield better results than the ones that can be obtained for an arbitrary indefi- 
nite quadratic programming problem. As we will see, it is not only the special 
properties of the feasible region (the set of n-dimensional probability vectors) 
that can be exploited, but also the properties of the eigenvalues and eigenvectors 
of nonnegative matrices and, more specifically, the spectral properties of adja- 
cency matrices of simple graphs. The following theorem, known as the Perron- 
Probenius theorem, states some basic facts about the principal eigenvalue and 
eigenvector of a nonnegative matrix: 

Theorem 8. Any nonnegative square matrix has a nonnegative real eigenvalue 
Ai with maximum absolute value among all eigenvalues and a nonnegative real 
eigenvector Zi corresponding to this eigenvalue. If the matrix has no block tri- 
angular decomposition, then Ai has multiplicity 1 and the entries of the corre- 
sponding eigenvector zi are strictly positive. 

In the sequel we will frequently make use of certain results of spectral graph 
theory, including the above mentioned theorem of Perron-Frobenius which is 
generally applicable to nonnegative matrices. For the basic theory and results of 
graph spectra the interested reader is referred to [2] and [6] . 

In the next section we further explore the specific characteristics of a game 
as an indefinite quadratic programming problem in the context of win-lose {0, 1} 
games. Considering win-lose games provides an explicit link of the game problem 
with the spectral properties of simple graphs. 

6 Win-lose games and induced graphs 

The analysis and results in the preceding sections are generally applicable to 
games with arbitrary payoffs. In this section we restrict attention to win- lose 
games where each payoff entry is either or 1. 

Considering win-lose games is no loss of generality in terms of the complexity 
of computing Nash equilibria. In J] it is proven that the computation of Nash 
equilibria for two-player games with rational payoffs is polynomially related to 
the computation of Nash equilibria for win-lose games, i.e. there is a polynomial 
time reduction of the Nash equilibrium problem from two-player games with 
rational payoffs to win-lose {0, 1} games. Therefore, finding a Nash equilibrium 
for {0, 1} games is also PPAD complete. 

In order to avoid trivial cases (for example, cases where pure Nash equilibria 
exist), it is necessary to impose additional conditions on the matrix A (in addi- 
tion to those of Section 3): Aij -\- Aji < 1, i.e. that Aij and Aji cannot be both 
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equal to 1. Under this condition, the matrix A can be considered as the adja- 
cency matrix of a simple directed graph and, consequently, the matrix A + 
can be considered as the adjacency matrix of the undirected version of the same 
simple graph. We call this graph the induced graph of the game specified by 
the matrix A and we denote it by G = (V, E) with nodes the set of pure strate- 
gies V = [n] and edges E — : A^j = 1} cVxV the payoffs. Assume that 
the direction of each edge (in the directed version of the induced graph) is from 
a row to a column of matrix A, i.e. if is an edge, it is outgoing from i and 
incoming to j. 

Using the reduction to symmetric games obtained in Section 3 and the form 
of the matrix A in the general case, we can consider only bipartite graphs with- 
out loss of generality. For bipartite graphs, the spectrum is symmetric, i.e. the 
number of positive eigenvalues is equal to the number of negative ones and each 
negative eigenvalue is equal in absolute value with a positive eigenvalue. How- 
ever, the derivations and results presented here do not make explicit use of the 
bipartite nature of the underlying graph. 

Now, in order to avoid other less trivial cases (for example, cases where 
the problem can be reduced to smaller dimension by a polynomial procedure) 
another condition on matrix A should be imposed, if we take into consideration 
the Perron-Probenius theorem, stated in the previous section. Specifically, the 
existence of a block triangular decomposition of the adjacency matrix implies 
that the induced graph G is disconnected. In such a case we can decompose the 
game into subgames of smaller dimension, where, each subgame is represented 
by a principal submatrix of A (a sumbatrix formed by a subset of rows and 
the corresponding subset of columns of A). Evidently, if we pick any subgame 
and find a Nash equilibrium of it, then, this equilibrium will also be a Nash 
equilibrium for the original game. Therefore, we assume that the game specified 
by A cannot be decomposed, or, equivalently, the induced graph is connected 
(if this is not true, then we reduce the problem to lower dimension). Notice 
that we can check in polynomial time whether or not a graph is connected 
by solving a min-cut problem. Furthermore, as a consequence of the Perron- 
Frobenius theorem, if the induced graph is connected then the largest eigenvalue 
of A has multiplicity 1 and the corresponding eigenvector is strictly positive. 

Based on the above remarks, we summarize below the assumptions that we 
make on matrix A, without loss of generality as far as win-lose games are con- 
cerned: 

1. Each entry of A is either or 1 and every column of A contains at least one 
1. 

2. The entries of the principal diagonal are all 0: An — Q,\/i G [n]. 

3. The entries Aij and Aji cannot be both equal to 1, i.e. Aij + Aji < 1, Vz, j e 
[n],i¥=j- 

4. The set of neighbors of any row of A (the positions of I's in the row) is no 
subset of the set of neighbors of any other row. 

5. The undirected graph with adjacency matrix A + A'^ is connected. 
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As a corollary of the preceding discussion, we can express the following the- 
orem: 

Theorem 9. The problem of computing a Nash equilibrium for any bimatrix 

game can he polynomially reduced to a problem of computing a minimum of a 
function of the form fA^x) = uiax{Ax) — x'^Ax, where A is the adjacency matrix 
of a simple directed graph having properties 1 — 5 above. 

Recall that in case where any of the properties 1 — 5 is not satisfied, the problem 
can be either reduced polynomially to a smaller one or there will be trivial Nash 
equilibria. 

7 Approximating an equilibrium 

In order to approximate an equilibrium, one can take advantage of the prop- 
erties of stationary points (in particular equation (5)) as well as the spectral 
representation of the function fAix) and the properties of the eigenvalues and 
eigenvectors of simple graphs. In principle, a grid of points can be appropriately 
constructed and using each point in the grid as a starting point, a stationary 
point can be computed using the descent algorithm mentioned in Section 4. If 
the grid is dense enough in a well defined sense, then, one of the stationary 
points produced should be close to an equilibrium. The important issue is how 
close one can get as a function of the pric;e that has to be paid in terms of the 
density of the grid (hence the complexity of the algorithm). 

Consider the linear m-dimensional subspace e 3?" spanned by the eigenvec- 
tors Zi,i — 1,2, ... ,m that correspond to the positive eigenvalues and the metric 
d{., .): d^(a, b) = X^I^i ^ii^Ii^ ~ defined on this subspace. Consider the or- 
thogonal projection of the feasible region An on this subspace and denote it 
by Pm{An). Denote by Pm{x) the projection on this subspace of an a; G Z\„. 
It can be shown that Pm{An) is the convex hall of the projections of all the n 
vertices of An on the subspace. In general, the number of vertices of the convex 
hall should be less than or equal to n. Notice that the projection of any prob- 
ability vector in Z\„ on the subspace is an m-dimensional vector that can be 
expressed as a convex combination of at most m+1 vertices of the convex hall 
(by Caratheodory's theorem). Also, notice that the vertices of the convex hall 
can all be computed in polynomial time. 

Let e be a positive approximation parameter and assume that 1/e is integer 
smaller than m. Let us consider a set of regions in Pm{An) each consisting of 
convex combinations of no more that 1/e vertices of Pm{An). Since each vertex 
is the projection of some vertex of An, the set of such regions consist of the 
projections of all n-dimcnsional probability vectors with support no more than 
1/e. The total number of such subsets of vertices of Pm{An) is < n^/^ and so is 
the total number of the corresponding regions. Let us denote the set of all such 
regions by H{e). This set of regions thus constructed constitute an approximation 
architecture of all points in Pm{An). The crucial question is how well does it 
approximate the entire Pm{An), i.e. what is the largest distance of a point in 
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Pm(Z\„) from the union of all sets in H{e) in the metric d{., .). In regard to this 
question we can express the following theorem: 

Theorem 10. For any y G the closest, in the metric d{., .), point x € An 
whose projection belongs to [J H{e) satisfies the relationship: cP{Pm{x), Pm{y)) < 
£^(m), where, ^(m) = YliLi h/n. 

Proof. Consider the matrix = X^I^li ^i^j^I- This is a nonnegative definite 
symmetric n x n matrix with rank m which represents the positive part of the 
spectrum oi A -\- . For a given y € An with large support (of the order of 
m (but no more than m + 1) to ensure that its projection Pm{y) is as far as 
possible from any convex combination of a subset of 1/e vertices of Pm{An)), 
and X G An such that Pm{x) G [jH{e) (i.e. the projection Pm{x) of x is a 
convex combination of no more than 1/e vertices of Pm{An)), we should have 
the relationship: 

(f{Pm{x), Pm{y)) = {x- yyA+{x - y) (9) 

Let the scalars ii for i = l,2,...,n be defined as Zi — zjy. Define a new 
symmetric nonnegative definite matrix A'_^_ = Yl^i ^i{zi — Zie){zi — ZieY = 
{I — ey'^)A+{I — ye"^) (e is the all I's vector). Then, given that x and y are 
probability vectors we can write the previous equation as: 

(f{Pm{x),Pm{y)) = X-'A'^X (10) 

Let /Lti, H2, ... be the eigenvalues of A'^. By construction, the sum of /^i's (that is 
to say the trace of the matrix A'j^) should be < than X]"=i (the trace of matrix 
A_|_). Notice that the set supp{x) can be any subset of size \supp(x)\ < 1/e. So, 
the minimum of (P{Pm{x), P„i{y)) with respect to x is over all principal subma- 
trices of A'_^ of size 1/e x 1/e. Let S'(e) be a subset of indices in (l,r?,) defining 
such a submatrix and let G{e) be the submatrix itself. Then, (P{Pm{x), Pm{y)) = 
x'^G{£)x. It can be verified that, given an S'(e), the minimum of the latter ex- 
pression with respect to x € An with supp{x) C >5'(e) is given by an expression of 
the form 1/e'^G^^e, where, e here is the all I's vector with support 5(e) and 
is the; inverse of a principal submatrix of A'_^ of size 1/e x 1/e if it exists, or it can 
be replaced by the pseudo inverse (generalized inverse) without loss of generality. 
It turns out that cP {Pm{x) , Pm{y)) can be bounded by an expression of the form 
1/ SigS(e) where, /x-, i G S{s) are the eigenvalues of the submatrix G{e). Us- 
ing the harmonic-arithmetic mean inequality, the latter expression is bounded 
from above by Eies(e) /^i/l'5(£)P = e^iesie) l^i/\S{e)\ = etr{G,)/\S{e)\. Since 
all submatrices G^ of size 1/e x 1/e are considered, there is one whose aver- 
age trace is minimum, which implies tr{Ge)/\S{e)\ < tr{A'^)/n. So, the bound 
becomes: 

m 

rf2(P„(a;),P„(y)) < str{A'^)/m < eJ^K/n = £^{m) (11) 

1=1 

Finally, the claim of the theorem follows from the last relationship. 

□ 
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Based on the above theorem, we have the following result: 

Theorem 11. For any £ > 0, there is an algorithm, to find an e- approximate 
Nash equilibrium in time n^'"*^/^, where, ^(m) = ^i/"- 

Proof. Since all points y in Pm{^n) can be covered by balls of the form cf{x, y) < 
e^{m), for x G H{e), we can consider all n^/^ points of H{e) as starting points 
for the descent algorithm and compute constrained stationary points within each 
such ball. One of them will be £^(m)-close to a Nash equilibrium. 

Also, since the parameter e can be chosen arbitrarily, one can choose e/^(m) 
in its place to get an £-approximation in n^^™^/^ time. 

□ 

As an immediate consequence of the above theorems, we can express the 
following: 

Theorem 12. For a class of games for which the positive eigenvalues satisfy 
the relationship J^TLi M/n= constant, then there is a PTAS for this class. 

We conclude with the theorem below that establishes a general upper bound 
on ^ (m) for all instances of games and corresponding induced graphs. 

Theorem 13. The following relationship holds: 

m 

^{m)=Y^Xi/n<y/^ (12) 

i=l 

Proof. Since the Xi 's arc the eigenvalues of the adjacency matrix A + of the 
induced undirected graph, the sum of squares of the 's is equal to the trace of 
the matrix (A + A'^)'^ which is equal to the number of walks of length 2 in the 
graph for each node, i.e. twice the number of edges which is < n{n— l)/2. Using 
this fact and standard inequalities we obtain: 

m m n 

i=l i=l i=l 

which implies that: 

m 

Xi/n < y/m (14) 

i=l 

□ 

As a result of the last theorem, an e-approximate equilibrium can be com- 
puted in time bounded by n'^l^ , where m is the number of positive eigenvalues 
of the matrix A-\- AJ . 
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8 Discussion and future work 



In this work it was demonstrated that the general problem of computing an 
approximate Nash equilibrium of a bimatrix game can be reduced to a problem 
of computing an approximate symmetric equilibrium of a symmetric {0, 1} win- 
lose game involving a single n x n matrix A which is the adjacency matrix of a 
simple directed graph. The complexity of the problem is due to the positive part 
of the spectrum of the symmetric matrix A + A^ (which is the adjacency matrix 
of the undirected version of the graph), i.e. to the eigenspace corresponding to 
the positive eigenvalues Ai , A2 , . . . , Am ■ In particular, the geometry of the pro- 
jection of the n-dimensional simplex Z\„ onto the positive eigenspace (denoted 
here by Pm(^n)) plays an important role in the analysis. As analyzed in Section 
7, for any e > 0, Pm(Zi„) can be covered by balls of squared radius e J2"!^i Xi/n 
centered at certain grid points in Pm(Z\„) whose number docs not exceed n^^^. 
Based on this and using the properties of stationary points as summarized in 
Section 4, it is shown that by running the descent algorithm at most n^/^ times 
independently, each starting from a distinct point of the grid, one of the sta- 
tionary points thus obtained is £j2^i Aj/n-close to an equilibrium. Finally, by 
appropriate choice of the parameters, it turns out that it is possible to achieve an 
e-approximatc cquilibrimn in time loss than n^^'")/'^, where £,{rn) = )^i/n. 

There are some issues that can be further investigated to improve the results. 
At first, the grid that was used to subdivide Pm(Z\„) basically consists of the 
projections on the positive eigenspace of all n-dimcnsional probability vectors 
whose entries are integer multiples of a given e. The question is: Is it possible to 
further exploit the structure of Pm(^n) and to use a different grid containing 
less points that could yield better results? 

Secondly, and more importantly, the complexity as a function of the positive 
eigenvalues depends on the quantity ^(m) = K/n which is always < ^/m 

(which implies our subexponential complexity result in this paper). However, the 
y/m bound for ^(m) is not tight. In fact, the equality holds only if all positive 
eigenvalues are equal (i.e. the multiplicity of Ai is m) which in turn implies that 
the induced graph is not connected (this is a consequence of the Perron- Frobenius 
theorem and a standard result in spectral graph theory). But if the graph is not 
connected, the game problem can be reduced in dimension as analysed in Section 
6. The question is: Is there a better upper bound in any significant way for ^{m) 
that explicitly takes into account the connectivity of the induced graph? 

As pointed out in Theorem 12, if for some class of games the expression ^(m) 
is a constant, then our approach leads to a PTAS for this class. In general, it 
appears that the study of the positive spectrum of the adjacency matrix A + A^ 
can elucidate several aspects of an equilibrium problem (notice that eigenvalues 
and eigenvectors can be computed in polynomial time). The expression ^(m) can 
be used to characterize classes of game problems according to the difficulty in 
approximating equilibria. 

The distribution of the principal graph eigenvalues and corresponding eigen- 
vectors are already being heavily used in a variety of applications such as in 
expander graphs, spectral partitioning algorithms, page ranking algorithms, etc. 
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It is conjectured that further study of the principal eigenvalues and eigenvectors 
of graphs with an eye on game problems can yield improved results and algorith- 
mic approaches for the computation of approximate and exact game equilibria 
as well. 

Acknowledgements: We wish to thank C. H. Papadimitriou, X. Deng and 
Y. Ye for many useful comments on an earlier version of this work. 
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